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Abstract. Given a long knot diagram D and a finite quandle Q, we 
consider the set of all quandle colorings of D with a fixed color q of 
its initial arc. Using this set we define the family &q(K) of quandle 
automorphisms which is a knot invariant. For every element x £ Q one 
can consider the formal sum S%(K) = £^ <!>(%), taken over all </> £ 3>q. 
Such formal sums can be applied to a tangle embedding problem and 
recognizing non-classical virtual knots. 



1. Introduction 

Let ttk denote the fundamental group of the complement of a knot K 
in § 3 , rax be the meridian of K and Ik its longitude (see |B-Zj for defini- 
tions). It is well known that, up to isomorphism, the triple (ttk, tuk, Ik) is 
a classifying invariant of the knot: 

Theorem 1 ( Wal ). Two oriented knots K and K' are isotopic if and 
only if there is an isomorphism (ft: ttk — ► kk' such that <ft(m,K) = mjf and 
<!>{Ik) = Ik>- 

Given the power of the group system (ttk, thk, Ik), it is natural to try 
to use the pair (tuk, Ik) when designing knot invariants. In |Eisj . M. Eiser- 
mann defined the following invariants. For a finite group G and an element 
x £ G, consider the set of all representations p: ttk — » G, with p(uik) = x. 
The sum Y2oPQk)> w hich is an element of the group ring ZG, is a knot 
invariant. These invariants were successfully applied to detecting chirality 
and non-inversibility of some knots. 

In this paper, we change this idea so that it can incorporate quandles, 
and then use it to find obstructions to tangle embeddings. Our invariants 
can be easily generalized to the virtual category, and give some information 
about non-classicality of virtual knots. 
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Figure 1. Two types of crossings with quandle generators 
assigned to arcs. 



Now let us recall the definition of a quandle as given in Joy . 
Definition. A quandle is a set Q equipped with two binary operations *, *, 
satisfying the following identities: 

Ql. x * x = x, for all x G Q; 

Q2. (x * y) * y = x = (x * y) * y, for all x, y E Q; 

Q3. (x * y) * z = (x * z) * (y * z), for all x, y, z € Q. 

Let the symbol * e € {*, *} denote a generic quandle operation, so that 
the meaning of x * e y is either x * y or x* y. We will use subscripts to 
specify several possibly different operations. If the symbol * e is already 
used, then the symbol denotes the opposite operation. For example, 
if * e = #, then * _e = *. We use a standard convention for products in 
non-associative algebras, called the left normed convention i.e., whenever 
parentheses are omitted in a product of elements a\, 02, ... , a n of Q, then 
ai * ei a 2 * £2 . . . * £n ~ 1 a n = ((... ((ai * £1 ^2) * €2 03) * es . . .) * €n ~ 2 a„-i) a„ 
(left association) for example, a * b* c* d = ((a*b)*c) * d. 
Definition. A homomorphism of quandles Q and Q' is a map /: Q — > 
Q' satisfying the condition /(x * y) = /(x) * /(y), for all x, y £ Q. An 
automorphism of Q is a bijective homomorphism /: Q — > Q. 

A basic and important example of the automorphism of a quandle Q is a 
function f q defined by f g (x) = x * q, where q, x € Q, or a function / g given 

by /gO) =x*q. 

Initially we will work with classical long knots. 
Definition. A long knot diagram is a smooth immersion / : R R 2 with 
crossing information at each double point, and such that /(x) = (x,0) for 
|x| sufficiently large. 

Long knot diagrams are assumed to be oriented from the left to the right. 

Given a diagram D representing the long knot K, we can assign to it 
the fundamental quandle Q(K). Its generators correspond to arcs of the 
diagram, and relations correspond to crossings and are of the form: x,*Xfc = 
Xj if crossing is as in Fig^a) or Xj * x& = Xj in the case of crossing depicted 
in Fig^b). Q(K) does not change (up to isomorphism) under Reidemeister 
moves, so it does not depend on the long knot diagram that we choose (see 



Joy for details). 



We can obtain a closed knot K from a long knot K by joining the initial 
and the last arcs of K. To define the fundamental quandle of K, we only 
need to add to Q(K) one relation identifying generators corresponding to 
arcs that are being joined. 

The following definition applies to both long and closed knots. 



c(0 



C(r) 

Figure 2. Quandle coloring relation. 

Definition. Let X be a fixed quandle and D be a given diagram of an 
oriented knot K. Let R be the set of arcs of this diagram. The normals 
of arcs are chosen so that the pair (tangent, normal) matches the usual 
orientation of the plane. A quandle coloring C is a map C : R — > X such 
that at every crossing the following relation is satisfied: if r is the over- 
arc at a crossing, and T\ is the under-arc such that the normal of r points 
away from it, then the second under-arc should receive color C(ri) * C(r) 
(see FigEJ. For a survey on quandles and quandle colorings see |C~-K-S . 
Alternatively, quandle coloring can be viewed as a homomorphism from the 
fundamental quandle Q(K) to the quandle X. 

2. Colored quandle longitudes 

Let D be a diagram of the long knot K with the initial arc denoted as r\ 
and Q be a finite quandle. Let us fix an element q G Q. We can consider 
the set Col(D,Q,q) of all colorings of D with quandle Q, satisfying the 
condition that the color of 7*1 is q. 

The cardinality of this set is a knot invariant, but we would like to obtain 
stronger invariant by means of longitudinal information. 

In the context of the fundamental quandle Q(K), the longitude can be 
described as follows. 

Definition. Travelling along the knot diagram D from the left to the right, 
we label the arcs of D by generators x\, . . . , x n+ \ of Q(K), in a consecutive 
manner (see Fig|21for an example). Here, n is the number of crossings of 
the diagram. Let x ^ denote the generator assigned to the over-arc that is 
encountered between arcs labeled by X\ and Xj+i, and let v(i) be equal to 
1 if the normal to this over-arc points away from arc labeled Xj (Fig^a)) 
and -1 otherwise (Fig^b)). 

The quandle longitude is an automorphism n: Q(K) — > Q(K) defined by the 
formula 

<q(x) = x *" £1 xi * ei x o{1 ) *~ e2 x 2 * 62 x o( 2) *~ £3 • • • *" £n x n * 6n x o(n) , 
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Figure 3. A long diagram of the knot 5 2 . 

where * €i = * if v(i) = 1 and * €i = * otherwise. 

For example, the quandle longitude for the long knot 5 2 on FigElcan be 
written as 

775 2 (x) = X * X\ * £4 * X 2 * X$ * X3 * X 2 * X4 * X\ * X5 * X3 . 

To simplify the notation, we will describe the quandle longitude as a list of 
generators, in exactly the same order as in definition of r/, with the following 
additional information: if generator Xi is to be preceded by the operation *, 
it will be written as ~xj, otherwise it will be left as X{. 
Thus, we write the quandle longitude in our example as 

{xi, xg, x 2 , xE, x 3 , xi, xi, x 5 , X3"}. 

For a slightly different definition of the quandle longitude, suitable for 
framed knots, see K99 . 

Now we can unify the idea of the quandle longitude with the idea of 
quandle colorings. 

Definition. Let C be the quandle coloring of the long knot diagram D, using 
some fixed quandle Q. Then the colored quandle longitude corresponding to 
£ is the automorphism <^ : Q — > Q, defined by the formula 

C ( X ) = X*- ei C(xi)* ei C(^o(l))*^ 2 C(^)* e2 C(Xo( 2 ))*" e3 . • .*- en ((Xn)* en ((Xo(n)), 

where x E Q, and we apply conventions from the previous definition when 
determining the type of the operation that is used. The colored quandle 
longitude is not changed by Reidemeister moves. 

If C was the coloring of the long knot 5 2 from the example, then we would 
write the corresponding colored quandle longitude as 

{((xi), C(x4), C(x 2 ), C(x 5 ), C(x 3 ), C(x 2 ), ((x 4 ), C(xi), ((x 5 ), C(X3)}- 

Now we are ready to define our invariants. 
Definition. Let D, K, Q, Col(D, Q, q) be as in the beginning of this section. 
Then we can define the colored quandle longitude invariant <&q(K) as the 
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family of all colored quandle longitudes corresponding to the set of colorings 
Col{D, Q, q) i.e., <f> q Q (K) = \ ( € Col(D, Q, q)}. 

The next natural step is to choose an element x £ Q, and consider the 
formal sum 

sg(JO = $>(*). 

taken over all <fi € 5>q, which is an element of the free Z-module generated 
by elements of Q. 

The above invariants were defined for long knots, but it is well known that 
in the classical case the long knot theory coincides with the theory of closed 
knots. Any two long knots obtained from the closed knot by breaking it at 
two different points are the same, one can be obtained from the other by a 
sequence of Reidemeister moves. Thus, our invariants are well defined for 
classical closed knots, for their value is the same for all long knots obtained 
from the closed knot by breaking it at some point. 

Let us apply these invariants to show that the knot 52 is not equivalent 
to its mirror image. 

Example. We choose the coloring quandle Q to be the conjugacy class 
of the element q = (1,2)(3,4, 5) in the symmetric group S§, with quandle 
operations defined as a * b = & _1 ai> and a*b = bab , where on the right 
hand side we have a group multiplication in S$. Q has 20 elements. As 
an element x that will be acted upon by colored quandle longitudes, we 
choose permutation (1, 2, 3)(4, 5). There are 7 colorings of the long knot 52 
(FigEJ with q being the color of the initial arc, therefore we have 7 quandle 
automorphisms acting on x. The value of the invariant is 

5|(5 2 ) = 6-(1,2,4)(3,5) + (1,2,3)(4,5). 

The element (1, 2, 3)(4, 5) in the above sum is a result of acting on x by the 
colored quandle longitude corresponding to monochromatic coloring (i.e., 
when all arcs receive color q). It is an identity automorphism. 
Let 52 denote the mirror image of the knot 52- The value of the sum for this 
knot is 

S% (51) = 6- (1,2, 5) (3, 4) + (1,2, 3) (4, 5). 
Since these values are different, the knot 52 is chiral. 

We can apply similar technique to show chirality of the knot 942 that is 
known to be the smallest chiral knot not distinguished from its mirror image 
by the Homflypt and Kauffman polynomials. 

In this case we take Q to be the alternating group A§ with conjugation as 
the quandle operation. Let q = (1,2,3) and x = (2,3,4). The values of the 
invariant circ cis follows: 

S , S(9 42 ) = 7- (2, 3, 4) +6 .(1,4, 3), 

S , |(9 4 i) = 7-(2,3,4)+6-(l,2,4). 

These and other computations included in this paper were obtained using 
the computer algebra system GAP |GAP4j . 
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3. Applications to tangle embeddings 



A 2n-tangle consists of n disjoint arcs in the 3-ball. We ask the following 
question, that was first considered by D. Krebes |Krej . For a given knot 
K and a tangle T, can we embed T into K i.e., is there a diagram of T 
that extends to a diagram of Kl This problem is important due to its 
applications in the study of DNA. A number of knot invariants have been 
used to find criteria for tangle embeddings (see for example |P-S-Wj , |Rub| ) . 

Here, we use invariants from the previous section to define obstructions to 
tangle embeddings. We will work with oriented 4-tangles i.e., tangles that 
have two inputs and two outputs (see Fig0]for an example), but our method 
is applicable for general 2n-tangles . 

First, we need a definition of particular kind of tangle coloring, that is 
necessary ingredient in what follows. 

Definition. Let Dt be a tangle diagram, and Q be a quandle. A boundary- 
monochromatic coloring of Dt is a map from the set of arcs of Dt to quandle 
Q satisfying the usual conditions for quandle colorings of knot diagrams, and 
an additional requirement that all boundary points receive the same color. 

If a tangle T embeds into a knot K, then each boundary- monochromatic 
coloring of Dt can be extended trivially to the whole diagram of K i.e., all 
arcs outside Dt receive the color of the boundary points of Dt- Thus, the 
existence of nontrivial colorings of Dt gives the first basic obstruction to 
tangle embeddings, for T can possibly embed only into knots admitting at 
least the same number of nontrivial colorings (see also |Krej ) . 

Let us proceed to define our obstructions. 
Suppose that a tangle T embeds into a long knot K i.e., there exists a tangle 
diagram Dt, and a diagram D of K such that Dt is a part of D. Let Q be 
a finite quandle, q £ Q, and let CoIq(Dt) denote the set of all boundary- 
monochromatic colorings of Dt with colors from Q, such that the color of 
the boundary points of Dt is equal to q. 

Each coloring Cd t € CoIq(Dt) determines a coloring C € Col(D,Q,q) (by 
extending Cd t trivially to D). 

For every such coloring C, diagram Dt yields two parts of the colored quan- 
dle longitude <f>^, obtained by traveling along two components of tangle T 
according to the orientation of T. Let us denote these parts as 4>\ and (f^. 

In the case of tangle T^ 2 from the Fig^l longitude parts would be as 
follows: 

4>\ = {C(xi), Cdmj, C(x 2 ), CM, CO**), CM}, 

starting from the lower left corner, and 

4>l = {C(yi), CW, CG/2), CM, CM, CN}, 

starting from the upper right corner of Dt &2 ■ 

Notice that we do not know a priori which longitude part appears first in 
(j)^ therefore, we must take into account both possibilities. 

^Many authors use the name n-tangles for such objects having n inputs and n outputs. 
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Figure 4. Tangle T &2 . 



Each crossing of D that is outside of Dt contributes {q, q} or {q, q} to 
cj>£ (all arcs outside Dt have color q). This contribution is trivial because of 
the second axiom from the definition of quandle. 
Let . denote the concatenation of lists. We have the following result. 

Theorem 2. Let Q, q, T and K be as above. If T embeds into K then 
either . 0^ or ^ . ^ belongs to <3?q . 

This observation can be used when utilizing the formal sums S%. 

Corollary 3. IfT embeds into K, then either the sum 

Sf(T) =J>C 

or the sum 

taken over all colorings £ obtained from the boundary monochromatic color- 
ings of Dt, must be included in the formal sum 

that is taken over all colorings £ G Col(D,Q,q). 

If this condition is not satisfied for some choice of Q, q and x € Q, then 
tangle T does not embed into the long knot K. 

If the above method gives obstructions to embedding of T into a long knot 
K, then T will also not embed into a closed knot K obtained from K by 
joining its ends. Indeed, for any long knot obtained from K by breaking it at 
some point, the values of the invariants <£q, and therefore also obstructions 

to embeddings, are the same. Finally, if T embeds into K, then we can 
always choose a breaking point that is outside T. 

Let us consider an example of this application. 
Example. As quandle Q, we take the alternating group Aq with conjugation 
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Figure 5. A non-classical virtual knot. 

as a quandle operation. Let q = (1, 2, 3, 4)(5, 6), and x = (1, 2, 3, 4, 5). 
We consider the problem of embedding of tangle Tq 2 (Fig0J into a knot 63. 
Tangle Tq 2 has 9 colorings with the color of the boundary points equal to q. 
The values of the sums Sf (Tq 2 ) and S% (Tq 2 ) are equal: 

Sf (T 6a ) = SI (T 6a ) = 8 • (1, 2, 5, 3, 4) + (1, 2, 3, 4, 5). 

Any long knot obtained from the closed knot 63 has 33 colorings in Col(D, Q, q). 
All colored quandle longitudes corresponding to these colorings act trivially 
on the element x: 

S|(6 2 ) = 33- (1,2,3,4,5). 
Therefore, we conclude that tangle Tq 2 does not embed into knot 63. 

4. Applications to virtual knots 

Virtual knot theory was introduced by Louis Kauffman in [K99 . 
Definition. A virtual knot is defined as an equivalence class of 4-valent 
plane diagrams, with an extra crossing information, where a new type of 
crossing (called virtual crossing and denoted by a small circle around a 
double point) is allowed. 

Virtual knot theory is a generalization of classical knot theory; if two 
classical knots are equivalent under generalized Reidemeister moves, then 
they are equivalent under classical ones (see |(t-P-V| for the proof). 
Definition. By a long virtual knot diagram we mean a diagram satisfying 
the conditions required for a diagram of a classical long knot, but we allow 
virtual crossings to be present. 

Definition. A long virtual knot is an equivalence class of long virtual knot 
diagrams modulo generalized Reidemeister moves (see |Manj for details). 

Long virtual knots and their invariants first appeared in |(t-P-V| . where 
it was also shown that breaking the same virtual knot diagram at different 
points can produce different long virtual knots. 

The definition of the fundamental knot quandle, quandle colorings, and 
invariants that we defined in previous sections can be easily generalized to 
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virtual long knots. We simply ignore the virtual crossings and allow arcs to 
pass through them. 

Definition. We say that a virtual knot K is non-classical if every diagram 
of K contains at least one virtual crossing. 

Our invariants of long knots can be used to detect virtual knots that are 
non-classical. Indeed, it is enough to show that the values of the invariant 
S% applied to long knots obtained by breaking the same virtual knot are 
not equal. 

Another possibility of using these invariants follows from the fact that, 
unlike in classical case, the connected sum of long virtual knots Ki, is 
not commutative |K05| . If we can show that invariants &q of connected 

sums K\j^Ki and Kij^K\ are not the same, it will follow that K\ and K2 
are different and both non-classical. 

Example. Consider the virtual knot K depicted in Fig|SJ Let K\ and K2 be 

long knots obtained from K by breaking it at points A and B respectively. 

Let Q be the conjugation quandle of the permutation group generated by 

(1, 9, 6, 7, 5)(2, 10, 3, 8, 4) and (1, 10, 7, 8)(2, 9, 4, 6). 

We choose q = (2, 3, 4, 5)(6, 9, 8, 10), and x = (2, 5)(3, 10)(4, 9)(7, 8). 

Both knots have 17 colorings with the color of the initial arc equal to q. The 

values of the invariant SJ are as follows: 

SUKi) = (2, 6)(3, 7)(4, 10)(8, 9) + (2, 9)(4, 8)(5, 7)(6, 10) + 2 ■ (1, 2) (3, 5)(4, 7)(6, 9) 
+2 • (1, 2)(3, 6)(5, 9)(8, 10) + 2 ■ (1, 4)(2, 6)(5, 10)(7, 9) + 2 • (1, 4)(2, 9)(3, 8)(6, 7) 
+(1, 7)(2, 3)(4, 5)(9, 10) + (1, 7)(2, 5)(3, 4)(6, 8) + (1, 8)(3, 7)(4, 6)(5, 9) 
+(1, 8)(2, 10)(3, 6)(4, 7) + (1, 10)(3, 6)(4, 9)(5, 7) + (1, 10)(2, 8)(4, 7)(5, 9) 
+(2,5)(3,10)(4,9)(7,8); 
Sl{K 2 ) = (3, 9)(4, 7)(5, 6)(8, 10) + (2, 3)(4, 6)(5, 8)(7, 10) + (2, 4)(3, 5)(6, 8)(9, 10) 
+(2, 6)(3, 7)(4, 10)(8, 9) + (2, 7)(3, 8)(5, 10)(6, 9) + (2, 8)(3, 6)(4, 5)(7, 9) 
+(2, 9)(4, 8)(5, 7)(6, 10) + 2 ■ (2, 10)(3, 4)(5, 9)(6, 7) + (1, 6)(2, 7)(4, 9)(5, 8) 
+(1, 6)(2, 8)(3, 10)(5, 7) + (1, 7)(2, 3)(4, 5)(9, 10) + (1, 8)(3, 7)(4, 6)(5, 9) 
+(1, 8)(2, 10)(3, 6)(4, 7) + (1, 9)(4, 5)(6, 8) (7, 10) + (1, 10)(2, 3)(6, 8)(7, 9) 
+(2,5)(3,10)(4,9)(7,8). 

Since they are different, K is non-classical. 

Generalizations of the presented invariants to other quandle-like struc- 
tures, for example to biquandles, will be investigated in the future paper. 
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